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Executive Summary 

This report surveys the empirical research on school 
choice. It provides a thorough overview of what the 
research has found on five key topics: 

• Academic oufcomes of choice parficipanfs 

• Academic oufcomes of public schools 

• Fiscal impacf on faxpayers 

• Racial segregafion in schools 

• Civic values and pracfices 

The evidence poinf s clearly in one direcf ion. Opponenf s 
frequenfly claim school choice does nof benefif 
parficipanfs, hurfs public schools, cosfs faxpayers, 
facilifafes segregafion, and even undermines 
democracy. However, fhe empirical evidence 
consisfenfly shows fhaf choice improves academic 
oufcomes for parficipanfs and public schools, saves 
faxpayer money, moves sfudenfs info more infegrafed 
classrooms, and sfrengfhens fhe shared civic values 
and pracfices essenfial fo American democracy. 

These resulfs are nof difficulf fo explain. School choice 
improves academic oufcomes by allowing sfudenfs fo 
find fhe schools fhaf besf mafch fheir needs, and by 
infroducing healthy competition that keeps schools 
mission-focused. If saves money by eliminafing 
adminisfrafive bloaf and rewarding good stewardship 
of resources. If breaks down fhe barriers of residential 
segregation, drawing sfudenfs fogefher from 
diverse communifies. And if sfrengfhens democracy 
by accommodating diversify, de-polificizing fhe 
curriculum, and allowing schools fhe freedom fo 
susfain fhe sfrong insfifufional culfures fhaf are 
necessary fo culfivafe democratic virfues such as 
honesfy, diligence, achievemenf, responsibilify, service 
fo ofhers, civic parficipafion, and respecf for fhe righfs 
of ofhers. 

The size of fhe benefif provided by existing school 
choice programs is sometimes large, buf is usually more 
modesf. This is nof surprising because fhe programs 


fhemselves are modesf — curfailed by sfricf limifs on 
fhe sfudenfs fhey can serve, the resources they provide, 
and the freedom fo innovafe. Only a universal school 
choice program, accessible fo all sfudenfs, can deliver 
fhe kind of dramafic improvemenf American schools 
desperafely need in all five of fhese imporfanf areas. 

Key findings: 

• Twelve empirical sfudies have examined academic 
oufcomes for school choice parficipanfs using 
random assignmenf, fhe "gold sfandard" of social 
science. Of fhese, 11 find fhaf choice improves 
sfudenf oufcomes — six fhaf all sfudenfs benefit 
and five fhaf some benefif and some are nof 
affected. One sfudy finds no visible impacf. No 
empirical sfudy has found a negative impacf. 

• Twenfy-fhree empirical sfudies (including all 
mefhods) have examined school choice's impacf 
on academic oufcomes in public schools. Of fhese, 
22 find fhaf choice improves public schools and 
one finds no visible impacf. No empirical sfudy 
has found fhaf choice harms public schools. 

• Six empirical sfudies have examined school 
choice's fiscal impacf on faxpayers. All six find 
fhaf school choice saves money for faxpayers. No 
empirical sfudy has found a negafive fiscal impacf. 

• Eighf empirical sfudies have examined school 
choice and racial segregafion in schools. Of fhese, 
seven find fhaf school choice moves sfudenfs from 
more segregated schools info less segregated 
schools. One finds no nef effecf on segregafion 
from school choice. No empirical sfudy has found 
fhaf choice increases racial segregafion. 

• Seven empirical sfudies have examined school 
choice's impacf on civic values and pracfices such 
as respecf for fhe righfs of ofhers and civic 
knowledge. Of fhese, five find fhaf school choice 
improves civic values and pracfices. Two find no 
visible impacf from school choice. No empirical 
sfudy has found fhaf school choice has a negafive 
impacf on civic values and pracfices. 
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Empirical Studies on School Choice 



Positive Effect 

No Visible Effect 

Negative Effect 

Academic Outcomes of Choice Participants 

11 

1 

0 

Academic Outcomes of Public Schools 

22 

1 

0 

Fiscal Impact on Taxpayers 

6 

0 

0 

Racial Segregation in Schools 

7 

1 

0 

Civic Values and Practices 

5 

2 

0 


Note: Shows the number of empirical studies with each type of finding. The first row includes all studies using random-assignment methods. Other rows include all studies using all methods. 
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Introduction 

School choice programs allow parents to choose what 
schools their children will attend, public or private, using 
public funds. They are among the most prominent and 
successful reforms in the education field. There are now 
41 school choice programs in 22 states and Washington, 
D.C. More than 250,000 students use these programs to 
attend private schools.* 

The most well-known form of school choice is school 
vouchers, which give parents the ability to redirect their 
children's education funding to a participating private 
school for tuition support. More recently, education 
savings accormts have introduced an innovation to this 
model, allowing parents to use redirected funds for 
other educational services and expenses in addition to 
tuition costs; this further improves the reward for good 
stewardship of resources by schools, because parents can 
select schools for price as well as for quality. An alternative 
approach, tax-credit scholarships, gives donors a tax 
credit if they donate money to organizations that support 
private school scholarships. 

Perhaps the most important question about school choice 
is how it impacts academic outcomes, both for the students 
who use it and in the public schools at large. Defenders of 
the government school monopoly claim choice does no 
good for the students who use it, and harms public schools 
by "draining money" or by "creaming students" — that 
is, skimming off the best students who rise to the top 
and would be sought by private schools. School choice 
proponents, on the other hand, argue choice improves 
academic outcomes both for the participating students 
and for public schools at large. They say choice saves 
money for public school budgets rather than "draining" 
money, and sends all types of students to private schools 
rather than "creaming." They also point to the benefits 
of allowing each student to find the right school and the 
healthy incentives created by competition. 

School choice also raises other important policy questions. 
In addition to the impact on school finance, which is 
part of the debate over how choice affects public school 
outcomes, there is the question of whether and how much 
taxpayers benefit from school choice through improved 


stewardship of resources. Opponents of choice frequently 
have charged that it will exacerbate racial segregation 
in schools (which is already at epidemic levels in the 
government monopoly system) whereas supporters 
say choice is a tool for breaking down segregation. And 
opponents argue private schools will not teach students 
the civic values and practices upon which democracy 
depends, such as respect for the rights of others and 
civic knowledge. Meanwhile, supporters say choice 
strengthens those same democratic values and practices. 

A large body of empirical evidence examines these 
questions using scientific methods. Twenty years ago, 
before this body of evidence existed, there was some 
excuse for making policy based on speculation, anecdotal 
observation, and intuition. Today, the effects of these 
programs are known, and there is no longer any excuse 
for policymakers and opinion leaders to be ignorant of the 
facts. 

This report reviews the available empirical studies on the 
five policy areas previously described. For participant 
effects, a large body of studies using the "gold standard" 
method of random assignment is available, so this report 
reviews that evidence. For the other questions, it reviews 
all available empirical studies using any scientific method. 
It also discusses the most important methodological 
issues confronted by research on this subject, and some of 
the larger implications of what the research finds.^ 

This report is the third edition in a series, and the earlier 
editions contain information that may be of interest to the 
reader of this report. The first edition was published in 
January 2009.^ That report included only the research on 
how school choice impacts public schools; its discussion 
of the methodological issues involved in that research 
was more detailed than the overview provided here. 
The second edition was published in March 2011.^ That 
version added the research on participant effects, and also 
provided more methodological detail than is included 
here. Readers seeking more extended methodological 
discussions may wish to consult those editions. 

This edition brings the research reviews on academic 
effects up to date as of early January 2013, and adds 
reviews of the research on the fiscal, racial, and civic 
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impact of school choice. Previous editions bore the title 
"A Win-Win Solution" because the evidence on academic 
effects shows positive results both for participants and 
for public schools. This edition looks beyond those two 
constituencies to consider three ways in which school 
choice affects the democratic polity. Thus, school choice 
is not merely a win-win, but actually a "win-win-win" 
solution. 

Choice in Education 

Americans expect and demand the right to select their 
own goods and services in every area other than K-12 
education, including everything from food, housing, 
clothing, transportation, and medical care to magazines, 
haircuts, dry cleaning, and video games. If the government 
tried to assign people to live in certain neighborhoods or 
shop at certain grocery stores, Americans would howl in 
protest. They even expect and demand choice when it 
comes to education outside of K-12 schools — everywhere 
from colleges to trade schools to tutoring services. But 
when it comes to K-12 education, the American idea that 
people should have stewardship over their own lives 
and choose for themselves rather than have government 
dictate what they receive is not embodied in public policy. 

The arguments typically used to defend this lack of choice 
are empirically false or poorly reasoned. For example, 
teachers' unions claim that choice "drains money" from 
public schools. But how would Americans respond if they 
were told that from now on they would have to receive 
all their medical care from a doctor assigned to them by 
the government, rather than from their current family 
doctor, on grounds that their choice to seek care from 
their current doctor "drains money" from the budget of 
the doctor chosen by the government? 

Meanwhile, the idea that school choice might improve 
public schools is dismissed as ideological claptrap. In 
fact, the empirical evidence consistently shows that it is 
the case, and the reasons are not hard to explain. One 
reason choice would improve public schools is that it 
allows parents to find the right particular school for each 
individual child. Every child is unique and has unique 
educational needs. 


But probably the most important reason school choice 
would improve public schools is because it gives 
parents a meaningful way to hold schools accountable 
for performance. Under the current system, if a school 
isn't doing a good job, the only ways to get a better 
school — purchase private schooling or move to a new 
neighborhood — are expensive and impractical. These 
options are especially difficult for low-income and 
disadvantaged students. 

Thus, in the absence of parental choice, schools lack the 
healthy, natural environment of client empowerment that 
is essential to producing better performance in most other 
types of service institutions. Hospitals know they must do 
a good job or lose patients. Professionals like doctors and 
lawyers must provide good services or lose clients. Stores 
must provide good value or lose customers. This system 
is so critical to keeping institutions mission-focused that 
we take it completely for granted — everywhere but in 
K-12 schooling. 

It is widely agreed that monopolies generally provide 
poor quality because nothing bad will happen to them 
if they don't serve their clients well. When they get bad 
service, customers say, "I'll take my business elsewhere" 
because they know this is what will prompt better service. 
They do this to nonprofit institutions the same way they 
do it to businesses because they know it's not the presence 
or absence of profit that creates better performance but 
the presence or absence of client choice. 

The failure of education policy to embrace the American 
principle that people should have stewardship over their 
own lives and make their own choices is a great hindrance 
to reform. One way opinion leaders can rectify this 
problem is by making the public aware of the large body 
of empirical research that examines how choice impacts 
participants, public schools, and the civic community at 
large. 

Why Science Matters - the "Gold 
Standard" and Other Methods 

There is no such thing as a "scientifically right" education 
policy. Science cannot identify what education policy is 
most fitting to the intrinsic nature of the human person. 


A Win-Win Solution: The Empirical Evidence on School Choice | Third Edition 4 


The Friedman Foundation for Educational Choice 


or most aligned with America's ideals of freedom and 
democratic self-rule. To answer those questions, one needs 
other kinds of knowledge — knowledge about the nature of 
human life, the meaning of freedom and democracy, and 
the historic self-understanding of the American people.® 

However, abstract ideas and history are not by themselves 
an adequate basis for public policy. The public hears 
competing claims about the real-world effects of education 
policy in the concrete worid of the here and now. it wants — 
and rightiy so — to know which ciaims are true and which 
are faise. That is an empiricai question, and addressing 
such questions is the speciai right and duty of science.® 

When evaluating the effectiveness of an education policy, 
it is especially important to rely on empirical research 
of high scientific quality. The student outcomes that 
education reforms are designed to promote are affected 
by many different influences — including demographic 
factors (income, race, family structure, etc.), school factors 
(type of school, teacher quality, etc.) and intangibles such 
as the level of enthusiasm parents and teachers invest in a 
child's education. The job of social science is to disentangle 
the influence exercised by each of these factors as well as 
possible with the available evidence. 

A study that uses good research methods can overcome 
these problems and provide reliable information about 
what is influencing student outcomes. But if scientific 
procedures are not rigorously followed, or if people make 
judgments without first examining the science, it's easy 
to draw the wrong conclusions about what factors cause 
what outcomes. 

The gold standard for empirical science is the method 
known as "random assignment," in which subjects are 
randomly divided into a treatment group that will receive 
the treatment being studied (such as school choice) and 
a control group that will not receive it. Because the two 
groups are separated only by a random lottery, they are 
likely to be very similar in every respect other than the 
treatment. 

There is a substantial body of random-assignment research 
on the academic achievement of students who are offered 
school choice, which is reviewed in the next section of this 


report. (See that section for more about the importance of 
this method, and its results in studies of choice.) 

Where a significant body of random-assignment 
studies exists, priority should be given to those studies 
when considering the evidence. Their methodological 
superiority should be taken into accormt; it would make 
no sense to act as though they were no more reliable than 
any other kind of study. 

But although it may be the best kind of research, the 
gold standard of random assignment is not the only kind 
of research worth considering. Where it is not possible 
to conduct a random-assignment study, other kinds of 
research methods can produce useful information that 
sheds light on important policy questions. 

The next best research method is to track year-to-year 
changes in outcomes for individual students. Tracking 
individual students over time removes from the analysis 
most, though not all, of the influence of unmeasured 
factors. If a student is advantaged in a way that is not 
measurable, that advantage will typically be present in 
the student's outcomes for both year one and year two of 
the study; thus the change in outcomes between year one 
and year two will mostly be from other factors — though 
unmeasured factors will still exert some influence on the 
level of year-to-year change. Removing the influence 
of unmeasured factors allows the analysis to isolate the 
impact of the factors that are being measured, such as the 
offer of school choice. 

If it is not possible to track individual students, good 
research still can be conducted by tracking year-to-year 
changes in individual schools. It is reasonable to expect 
that the unmeasured advantages of the students in a given 
school will be similar from year to year. If a school had 
highly advantaged students last year, it probably will 
still have highly advantaged students this year. Mobility 
among the student population will create some change in 
student characteristics from year to year, but not so much 
that we cannot learn from school-level studies. 
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T here have been 12 studies using random- 
assignment methods to examine how school choice 
affects the academic outcomes of participanfs7 These 
sfudies consistently find thaf school choice benefits 
students. Six of them find that choice had a positive 
impact across all students participating. Another five 
find that choice had a positive impact on some student 
groups and no visible impact on other students. One 
study found no visible impact from choice. None find 
fhaf choice had a negative effect. 

The Importance of Random Assignment - 
the Gold Standard 

when examining academic effects of school choice 
on participanfs, this report focuses on studies 
using random-assignment methods. These studies 
separate subjects into "treatment" and "control" 
groups randomly. Random assignment generates 
high confidence that factors other than the one being 
studied — the "treatment" — are not influencing the 
results. 

The special value of random-assignment research is 
that it removes not only the influence of observable 
factors, such as demographics, but also the vast array of 
unobservable factors that researchers know influence 
education but cannot directly measure. For example, it 
is widely agreed that one of the key drivers of student 
outcomes is parental motivation; parents who highly 
value the education of their children are an important 
positive influence on outcomes. Random assignment 
assures high confidence that differences in facfors such 
as this are not influencing research resulfs. 

Unfortrmately, it is usually not possible to conduct 
random-assignment research on education policy. 
However, school choice has been one of the rare 
exceptions. When there are more applicants for a 
choice program than there are available slots, a random 
lottery is often used to determine who may participate. 
This creates a naturally occurring random-assignment 
research design. Students who win the lottery and 
are offered choice can be compared to students who 
lost the lottery and were not offered choice. If any 
sysfematic (i.e., non-random) differences between 


the outcomes of the two groups are observed, those 
differences can be affributed to the offer of choice, 
because nothing separates the groups but the offer of 
choice and randoirmess. 

Because random assignment is so preferable, if should 
be given priority whenever a large body of random- 
assignment studies exists. It would make no sense to 
ignore the difference between the proven reliability 
of gold-sfandard studies and studies that are more 
methodologically limited. 

What the Gold- Standard Studies Show 

There had been 10 random-assignment studies of 
academic effecfs of school choice on participanfs 
when fhe lasf edition of fhis reporf was published in 
2011. Readers seeking a descriptive overview of fhose 
sfudies should consul! thaf edition. Two additional 
studies have been published since then. These 12 
studies consistently find a positive impact from school 
choice. 

Among the 10 studies reviewed in the previous "Win- 
Win" report, six find a posifive impacf for all sfudenfs, 
and fhree find a posifive impacf for some sfudent 
groups (black sfudenfs in some sfudies; sfudenfs 
leaving especially bad public schools in others) with 
no visible impact on other groups. Probably the most 
plausible hypothesis to explain the studies finding 
benefifs for some groups but not others is that these 
student groups were served more poorly in their 
public schools and thus stood to gain the most from 
fhe opportunify to choose a new school. 

The remaining study, a reanalysis of dafa from a 
previous study, found no visible impacf from choice. 
However, fhe aufhors, Alan Krueger and Pei Zhu, 
introduced methodological changes that violated the 
normally accepted rules of social science. They changed 
the way students were classified by race. When sfudent 
self-identification is absent, the generally accepted 
method is to use the race of the father; Krueger and Zhu 
classified a sfudent as black if eifher parent was black. 
Further undermining the legitimacy of fheir mefhod, 
fhey made fhis change only for black sfudenfs rafher 
than following fhe same classificafion method with all 
students. Krueger and Zhu also added students with 
significant missing data to their data set, and failed fo 
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control for the students' baseline scores (a standard 
step in scientific education analysis). Unsurprisingly, 
through these manipulations they were able to lower 
the variable for statistical significance below the 
conventional threshold for recognizing a finding.® 

In a devastating rejoinder, Paul Peterson and 
William Howell (authors of the original study) 
published a series of 120 reanalyses of their data set, 
each using a different set of specifications. These 
analyses demonstrated that the positive finding for 
black students is robust across numerous different 
assumptions about racial identification. Howell and 
Peterson show that the positive effect disappears only 
if the analysis incorporates Krueger and Zhu's exact 
combination of arbitrary racial redefinition, students 
with missing data, and exclusion of baseline scores. 
Leave out any two of these three and the results are 
positive.^ The Krueger-Zhu statistical model must be 
regarded as discredited. 

As noted previously, two new random-assignment 
studies on the academic effects of participants have 
been released since the last edition of this report. 
One is a reanalysis of Howell and Peterson's New 
York City data. In 2003, a team of researchers led by 
John Barnard reanalyzed these data using a different 
statistical method; like Howell and Peterson they 


found academic gains for a subset of students, in 
this case students whose public schools had been 
particularly low-performing. This 2003 reanalysis 
was included in the last edition of the "Win-Win" 
report. A 2010 study, not included in the last edition, 
makes a further revision to that reanalysis's statistical 
method. This reanalysis, conducted by a team of three 
researchers including Barnard and another researcher 
from the 2003 team, tests the sensitivity of the result 
to different methodological assumptions. Using these 
alternate methods, it confirms the 2003 finding of 
academic gains from school choice among students 
from low-performing public schools. “ 

In the second new study, Matthew Chingos and 
Peterson examined the long-term results of a privately 
funded voucher program serving low-income 
elementary school students in New York City in the 
late 1990s. Black students who were offered vouchers 
in elementary school were 20 percent more likely to 
attend college within three years of the age they would 
be expected to graduate high school, 25 percent more 
likely to attend college full-time, and 130 percent more 
likely to attend a selective four-year college. They 
found no visible impact on the student population as 
a whole; the impact was visible for black students. 


TABLE 1 Academic Outcomes of Choice Participants 


Location 

Author 

Year 

Results 

Positive Effect 

No Visible Effect 

Negative Effect 

All Students 

Some Students 

New York 

Chingos & Peterson 

2012 


X 



New York 

Jin et. al. 

2010 


X 



D.C. 

Wolf et. al. 

2010 

X 




Charlotte 

Cowen 

2008 

X 




New York 

Krueger & Zhu 

2004 



X 


New York 

Barnarrf et. al. 

2003 


X 



New York 

Howell & Peterson 

2002 


X 



D.C. 

Howell & Peterson 

2002 

X 




Dayton 

Howell & Peterson 

2002 


X 



Charlotte 

Greene 

2001 

X 




Milwaukee 

Greene et. al. 

1998 

X 




Milwaukee 

Rouse 

1998 

X 





Note: This table shows all empirical studies using random-assignment methods. 
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Off the Gold Standard 

A great deal of empirical research has compared 
public and private school impacts on test scores using 
methods other than random assignment. This research 
question actually goes all the way back to the origins 
of modern education science. The Coleman Report, 
produced by James Coleman for the U.S. Congress in 
1966, attempted to identify input and quality factors 
in public schools that impacted student performance. 
Using the cruder statistical methods of the time, 
Coleman was unable to identify any factors that 
had an impact, in his subsequent research, however, 
Coleman found one school quality factor he could tie 
to better outcomes: Private schools performed better 
than public schools. 

Since then, education researchers using better data 
and methods have demonstrated that a number of 
school variables, most notably teacher quality, have a 
large impact on student outcomes. But comparisons of 
public and private school performance have always 
been an important presence in the education research 
field. 

Identifying all the non-gold-standard research that 
has been done on this question over the years would 
be too cumbersome to do here, and there is no need 
given the substantial and growing body of random- 
assignment studies. But it is worth noting that, like 
Coleman's, most of the studies that rise to a reasonable 
level of scientific quality have found in favor of private 
schools. 

Some studies simply have conducted "descriptive" 
comparisons, gathering information about outcomes 
without the availability of statistical methods that 
would establish a causal link between the public/ 
private variable and the outcomes. Other studies have 
attempted to establish causality. This requires a method 
that accounts for the fact that a direct comparison 
between public and private schools is comparing 
students with dissimilar family backgrounds — 
"choosers" and "non-choosers." There are various 
methods for doing this. 


One is instrumental variable analysis, which uses 
proxy measurements to estimate the probability that 
a student is in private school. A 1997 study by Derek 
Neal used an instrumental variable technique to 
calculate the probability that a student would be in 
a private school and found that students more likely 
to be in private school were less likely to drop out.^^ 
The limitation of this method is that the instrumental 
variable is never more than an imperfect proxy. 

Another approach is to compare the experiences of 
the same students in public and private schools. A 
2003 study by Jay Greene and Greg Forster found that 
disabled students using Florida's voucher program for 
children with special needs got better services and had 
better outcomes in private schools than those same 
students had received in public schools. This method 
is much better for purposes of measuring the impact 
of vouchers on those students. However, it limits the 
generalizability of the finding to others. 

Still another approach is to use "matched" samples, in 
which students with similar observable characteristics 
(such as demographics and initial test scores) are 
matched to one another, then tracked and compared 
over time. The School Choice Demonstration Project 
(SCDP), a research consortium sponsoring numerous 
studies on school choice programs, conducted a study 
of matched samples in Milwaukee in which voucher 
students were matched to similar public school 
students. Few visible differences were found in test 
scores until the fifth year of the study, and changes 
to the state testing policy that year make the results 
difficult to interpret.'^ The SCDP did find that students 
using vouchers to attend high school were more likely 
to graduate, more likely to attend college, and more 
likely to stay in college than their matched public school 
counterparts.^'’ The limitation of this method is that it 
only matches students by observed characteristics, not 
the unobserved ones (such as parental motivation) 
that are the core of the methodological problem. 
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T wenty-three empirical studies have been 
conducted on how school choice programs 
impact academic outcomes in public schoolsd^ Of 
these studies, 22 find fhaf choice improves academic 
oufcomes af public schools. The one remaining sfudy 
found fhaf choice had no visible impacf on public 
schools. No empirical sfudy has ever found fhaf choice 
had a negafive impacf on public schools. 

For academic oufcomes of public schools, fhis reporf 
looks af empirical sfudies using all mefhods. If is nof 
possible fo conducf random-assignmenf research 
on how choice impacfs public schools. Random 
assignmenf is possible only in sfudies of parficipanfs 
because of fhe nafurally occurring opporfunify 
fo conducf a random loffery when fhere are more 
applicanfs fo a choice program fhan fhere are slofs 
available. There is no nafurally occurring equivalenf 
fhaf would permif random-assignmenf research 
mefhods in sfudying fhe effecfs of choice on public 
schools. One musf fherefore furn fo ofher evidence. 

Forfunafely, fhis question has been sfudied only more 
recenfly and fhe amounf of evidence is manageable. If 
is also of good mefhodological qualify — increasingly so 
over time. The lasf decade has seen major improvemenf s 
in fhe qualify of sfudies on fhis question, fo fhe poinf 
where some sfudies approach fhe confidence level of 
gold-sfandard random assignmenf. 

If is also imporfanf fo bear in mind fhaf these studies 
are examining a different kind of quesfion from fhose 
examining impacf on parficipanfs. The absence of 
random assignmenf is nof as greaf a problem here. 
There is no acf of parenfal choice fhaf needs fo be 
overcome mefhodologically. "Choosers" and "non- 
choosers" are nof being compared. All fhe relevanf 
sfudenfs are non-choosers. The only comparison is 
befween schools exposed fo choice and schools nof 
exposed — which is usually an easier mefhodological 
barrier fo overcome. 

What the Studies Show 

There had been 19 sfudies of academic effecfs on 
public schools when fhe lasf edifion of fhis reporf 


was published in 2011. Readers seeking a descripfive 
overview of those studies should consult that edition. 
One additional study has been published since then. 
These studies consistently find fhaf school choice 
improves public schools. 

Among fhe 19 sfudies reviewed in the previous report, 
18 find a positive impacf. Signiticanfly fhe one sfudy 
fo find no visible impacf was also fhe only sfudy 
conducfed on a program fhaf infenfionally profecfs 
public schools from fhe impacf of fhe program. Thus, 
if does nof defracf from fhe research consensus fhaf 
choice improves public schools. 

Six sfudies examine Milwaukee's voucher program; 
all six find a posifive impacf on public schools. 
Milwaukee's voucher program is available fo all 
sfudenfs who meef an income resfricfion, so research 
mefhods in Milwaukee cannof compare "public 
schools wifh vouchers" fo "public schools wifhouf 
vouchers." They insfead compare public schools wifh 
many sfudenfs eligible for vouchers fo public schools 
wifh fewer sfudenfs eligible for vouchers. In one 
case, where individual sfudenf dafa were available, 
researchers used fhe number of nearby privafe schools 
participating in fhe voucher program as a measuremenf 
of voucher impacf. These mefhods are like fesfing fhe 
effecfiveness of a medicine by comparing fhe effecfs of 
a large dose fo fhe effecfs of a small dose, rafher fhan 
fo fhe effecfs of nof faking if af all. The research will 
fend fo make fhe effecf of vouchers look smaller fhan 
if really is. Buf if is fhe besf fhaf can be done given fhe 
absence of a better confrol. 

Eleven empirical sfudies have been conducfed on how 
fwo voucher programs and one fax-credif scholarship 
program in Florida have affecfed academic oufcomes 
af public schools. All 11 unanimously find fhaf choice 
has improved Florida public schools. One of fhese 
programs made all sfudenfs af underperforming 
schools eligible for vouchers, so researchers were 
able fo measure fhe impacf of vouchers in fwo ways: 
comparing performance af fhe same school before and 
after voucher eligibilify, and comparing very similar 
schools fhaf were jusf over or jusf under fhe fhreshold 
for voucher eligibilify. Researchers also were able 
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to measure the impact of "voucher threat" at low- 
performing schools fhaf were in danger of becoming 
eligible for vouchers. For fhe ofher two programs (a 
voucher program for sfudenfs wifh special needs 
and a fax-credif scholarship program for low-income 
sfudenfs) researchers used mefhods similar fo fhose 
used in Milwaukee. 

Six sfudies have been con dueled on fhe impacf of school 
choice programs in ofher places (Maine, Vermonf, 
Ohio, Washington, D.C., and San Antonio, Texas). 
Five of fhese sfudies find fhaf choice improves public 
schools; one finds fhaf it made no visible difference 
to public school outcomes. The outlier study finding 
no impacf is a sfudy of fhe federal voucher program 
in Washingfon, D.C. This is fhe nation's only school 
choice program wifh a "hold harmless" provision 
fhaf allocates additional money fo fhe public school 
sysfem fo "compensafe" for fhe loss of sfudenfs. This 
is infended fo insulafe fhe public school sysfem from 
the impact of school choice. Thus, fhe absence of a 
visible effeef in fhis sfudy does nof defracf from fhe 
research consensus in favor of a positive impacf on 
public schools. 

One new sfudy has been released since fhe lasf edition 
of fhis reporf. Matthew Carr examined the impact of 
Ohio's EdChoice voucher program on public schools. 
The EdChoice program provides vouchers fo sfudenfs 
affending public schools rafed as D or F by fhe sfafe 
for fhree consecufive years. Carr found thaf schools 
eligible for vouchers made greater year-fo-year 
fesf score improvemenfs even compared wifh low- 
performing schools labeled as failing by fhe sfafe fhaf 
were nof eligible for vouchers. Carr uses a fixed-effeefs 
model fo faefor ouf differences befween schools ofher 
than voucher eligibility.^® 

Alternative Theories 

As the first studies on how school choice affects 
public schools emerged, some speculated that the 
improvements they found in public schools mighf be 
caused by ofher faefors besides a posifive impacf from 
school choice. Subsequenf research rigorously fesfed 
fhese alfernative hypofheses and found fhem fo be 


unsupporfed. These fheories were more exfensively 
discussed in fhe original 2009 edition of fhis reporf. A 
brief summary of fhe issues appears here. 

One fheory speculafes fhaf fhe worsf sfudenfs may 
be more likely fo use school choice, leaving behind 
the better students in public schools. According to 
this theory, rather than "creaming" the best students, 
choice "dredges" the worst. As it happens, the direct 
evidence on this question (what little is available) 
supports neither the creaming nor the dredging 
hypothesis; choice participants appear to be similar to 
other students. Also, nine studies of Florida's voucher 
program targefing underperforming schools show fhaf 
it improved those schools simply by threatening them 
with vouchers.^® It is also worth noting that a number 
of sfudies have fracked fhe achievemenf of individual 
sfudenfs rafher fhan whole schools and still found fhaf 
school choice improves outcomes for sfudenfs who 
remain in public schools. 

Anofher fheory speculafes fhaf because choice 
improves schools' per-sfudenf finances (see fhe nexf 
section for discussion of fhis) fhe posifive efteefs of 
choice could result from fhis fiscal benefif. Of course, 
fhis would nof be an argument against choice even if 
if were frue. However, as nofed earlier, fhe evidence in 
Florida shows a posifive voucher effeef even when no 
sfudenfs acfually changed schools simply as a resulf of 
fhe fhreaf of vouchers. 

Two alfernafive theories focus on voucher programs 
fargefing underperforming schools in Florida and 
Ohio. One speculafes fhaf fhese programs produce 
a "stigma effeef" — schools assigned failing grades 
by fhe sfafe improve fo remove fhe sfigma of being 
labeled as failing, rafher fhan responding to vouchers. 
But stigma carmot explain the positive findings for 
Milwaukee, Florida's fwo ofher programs, or the 
century-old "town tuitioning" voucher systems in 
Maine and Vermont. Also, seven studies have used 
various methods to check for fhe possibilify of a 
sfigma effeef. All found fhaf vouchers had a positive 
impact independent of any sfigma effeef. 

The final alfernafive fheory is fhe "regression fo 
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the mean" or "mean reversion" hypothesis; low- 
performing schools are more likely to improve than 
get worse simply because they can't get much worse 
than they already are. However, as with the stigma 
hypothesis, regression to the mean carmot explain 
the positive findings for Milwaukee, Florida's ofher 
programs, and town fuifioning vouchers in Maine 
and Vermonf. Also, seven sfudies have examined this 
theory using various methods. All found no effecf from 


regression fo fhe mean.^^ Perhaps mosf imporfanf, four 
of fhe sfudies examining fhese programs use a mefhod 
known as regression disconfinuify; all four confirmed 
fhe positive effecf from fhe voucher program. A 
regression disconfinuify design excludes regression fo 
fhe mean because fhe schools in fhe freafmenf group 
(high-scoring F schools) and fhe confrol group (low- 
scoring D schools) begin wifh very similar fesf scores. 


TABLE 2 Academic Outcomes of Public Schools 


Location 

Author 

Year 

Results 

Positive Effect 

No Visible Effect 

Negative Effect 

Florida 

Chakrabarti 

2013 

X 



Florida 

Winters & Greene 

2011 

X 



Ohio 

Carr 

2011 

X 



Florida 

Figlio & Flart 

2011 

X 



Milwaukee 

Greene & Marsh 

2009 

X 



Ohio 

Forster 

2008 

X 



Florida 

Forster 

2008 

X 



Milwaukee 

Chakrabarti 

2008 

X 



Florida 

Chakrabarti 

2008 

X 



Milwaukee 

Chakrabarti 

2007 

X 



Florida 

Rouse et. al. 

2007 

X 



Milwaukee 

Carnoy et. al. 

2007 

X 



D.C. 

Greene & Winters 

2006 


X 


Florida 

FIgllo & Rouse 

2006 

X 



Florida 

West & Peterson 

2005 

X 



Florida 

Greene & Winters 

2004 

X 



Florida 

Chakrabarti 

2004 

X 



Milwaukee 

Greene & Forster 

2002 

X 



San Antonio 

Greene & Forster 

2002 

X 



Maine 

Flammons 

2002 

X 



Vermont 

Flammons 

2002 

X 



Milwaukee 

Floxby 

2001 

X 



Florida 

Greene 

2001 

X 




Note: This table shows all empirical studies using all methods. 
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T here have been six empirical studies examining 
the fiscal impact of school choice on taxpayers. All 
six of these studies find that school choice saves money 
for the public. Two studies examine every school 
choice program in the nation for all the years they've 
existed, making the research in this area an especially 
comprehensive overview of fhe issue in question. 

Measuring Fiscal Impact 

This report covers all empirical studies of actual school 
choice programs. It does not cover analyses that predict 
fiscal impact in future years using economic modeling; 
such analyses are not empirical studies. Analyses of this 
kind are familiar to policymakers and opinion leaders 
through the widespread use of legislative "notes" and 
comparable analyses to predict the impact of legislation. 
These analyses are legitimafe and important insofar 
as legislators and the public must have some basis on 
which to evaluate legislative proposals, and empirical 
data from the future are unfortunately not available. 
However, empirical research on actual program effects 
is preferable fo modeling that predicts the future. 

The public spends money on schools at all three levels 
of government — federal (10 percent), state (47 percent), 
and local (44 percent) — but significant fiscal impact 
from school choice occurs only at the state level. 
School choice does not have much immediate impact 
on federal and local faxpayer funding for schools, 
because funding at those levels is not highly sensitive 
to changes in school enrollment. Federal funding 
mainly flows through Title I for low-income sfudents 
and special-education programs; Title I allocates funds 
based on the demographics of the school district, and 
federal special-education spending was reformed in 
1997, specifically to discormect funding formulas from 
enrollment levels (to avoid creating a financial incentive 
to place students in special education). Meanwhile, 
local funding fypically comes from properfy taxes. 
Small amounts of federal and local funding do vary 
with enrollment, but these are too complex and too 
small as a percentage of education spending to be 
worth tracking.^® 

By contrast, school choice has a major impact on state 


funding. Spending on schools has been migrating 
toward the state level over time, to the point where 
education is now a very large portion of mosf sfafe 
budgefs, sometimes even reaching a majorify of the 
state general fund.^*’ This change has been driven 
primarily by concerns over equity in funding befween 
disfricfs. Because of fhose concerns, almosf every 
sfafe funds schools based on fheir enrollmenf levels, 
allocating a base amount per student to each district 
(usually with some adjustments for local conditions). 
Most states have two major systems for funding 
schools; a "formula funding" sysfem fhat distribufes 
fhe majorify of spending based on number of sfudenfs 
and a separafe fund for capifal expenses such as 
building cosfs. Meanwhile, almosf all school choice 
programs are enacfed af fhe sfafe level. 

As a resulf, school choice creates both savings and costs 
for sfafe budgefs. When a sfudenf uses school choice, 
the state must cover that student's cost to the choice 
program, but it also spends less on public schools 
by an amount equal to one student. The net impact 
of school choice is defermined by which of fhese is 
greafer, fhe savings or fhe cosf. For example, if a sfate 
confribufes $5,000 per sfudenf ouf of fhe tofal spenf in 
public schools, and it offers vouchers equal fo $4,000 
per sfudent, every sfudenf who uses fhe program will 
save state taxpayers approximately $1,000. 

There will be a small amount of variafion in both 
figures. Some sfudenfs will not use the full voucher 
amounf, fhus reducing fhe program cosf. Savings in 
public school spending also will vary from sfudent 
to student as a result of sfafe funding formulas fhat 
adjust spending somewhat based on local conditions 
in each district. 

This report looks only at fiscal impacf on taxpayers. 
Another relevant issue is its fiscal impacf on public 
schools. Despife claims fhat choice "drains" money, 
choice programs historically have made public 
schools better off financially; one sfudy estimated the 
total positive impact of school choice on local disfricf 
finances at more than $421 million.^^ When a student 
leaves a public school using a choice program, the 
school loses all the costs associated with educating 


15 edchoice.org 


edchoice.org 


that student but not all the funding. As has been 
noted already, almost all federal and local education 
spending does not vary with enrollment, so those 
funds stay when students leave. This means public 
schools are left with more money to serve the students 
who remain. This is one possible explanation for the 
positive impact choice has on public school outcomes. 

A recent empirical study on schools nationwide 
supports these findings. Benjamin Scafidi examined 
school finances in every state and found that out 
of a total of $12,450 spent per student in 2008-09, 
64 percent ($7,967) was made up of variable costs 
that change with the number of students enrolled. 
This means school choice programs would produce 
significant financial windfalls for local schools as long 
as they redirected less than that amount per student. 
While local taxpayers wouldn't immediately benefit 
greatly because property tax levels are not sensitive 
to enrollment changes, local schools would benefit 
a great deal because they would have more money 
to spend per student.^® Of course, it is possible that 
if school choice were generating large expenditure 
savings for local schools, local governments may 
eventually recover some of those savings for taxpayers 
by lowering property taxes. 

What the Studies Show 

The first fiscal analysis to measure the impact of a 
school choice program on taxpayers was conducted 
by Susan Aud and Leon Michos. They examined 
the federally funded school voucher program in 
Washington, D.C. This program is fiscally unique 
in a number of ways. It is the only federally funded 
school choice program; more important, it is the only 
school choice program in the nation that intentionally 
insulates public schools from the positive impact of 
school choice. The method for doing so is fiscal — the 
federal government allocates funds to city schools to 
"compensate" them for students who use vouchers. 

Aud and Michos found that as a result of the federal 
subsidies attached to the program, it saved city 
taxpayers $8 million per year as of 2006. However, 
using the city's per-student funding formulas, they 


also calculated that the program would save city 
taxpayers more than $258,000 per year even without 
the federal subsidy. They had sufficient data on 
voucher-using students to track funding adjustments 
for sfudent grade level, English-language learners, 
and special-education and low-income subsidies.^^ 

Aud provided another study of fiscal impact on 
taxpayers in 2007, in a study that examined the 
impact of every school choice program in the nation 
from 1990 to 2006. Because the first modern school 
choice program was created in 1990 and the only 
two prior programs (century-old voucher programs 
for small towns in Maine and Vermont) are designed 
to be revenue neutral, Aud's study was effectively 
calculating the full impact of school choice throughout 
its existence. 

In such a comprehensive study — examining 19 
programs over 16 years — Aud was not able to make as 
many detailed adjustments for the impact of sfudent 
demographics on funding levels. She therefore made 
conservative assumptions and limited her calculation 
of reduced school costs to "instructional" expenses. 
This will tend to underestimate the savings from 
school choice significantly. 

Nonetheless, Aud found that choice programs had 
saved state taxpayers more than $22 million. As noted 
above, she also found that local school districts had 
benefitted from reduced spending demands of more 
than $421 million. These local benefits occurred when 
reduced costs from students using choice were greater 
than reduced per-student revenues.^” 

Fiscal analyses are not just conducted by academic 
social scientists; states conduct them for a variety of 
purposes. The first of two publicly available fiscal 
analyses of school choice programs conducted by a 
state was released in 2008 by Florida's Office of Program 
Policy Analysis and Government Accountability. It 
found that Florida's tax-credit scholarship program 
saved the state $39 million in fiscal year 2007-08 
because reduced education costs were greater than 
foregone tax revenue by $1.49 per student.^* 
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As part of the School Choice Demonstration Project, 
Robert Costrell conducted exceptionally detailed 
analyses of the fiscal impact of the Milwaukee voucher 
program. Costrell continually updated and refined his 
analyses over multiple years, producing a number 
of reports. In addition to the detailed calculations 
involved in accounting for student demographics and 
the like, the Milwaukee voucher program contains 
a unique funding system — known locally as "the 
funding flaw" and strongly opposed by local leaders in 
the school choice movement — that transfers the local 
savings generated by the program from city property 
taxpayers to the rest of the state (both through reduced 
property taxes in other areas and in savings on state 
taxes). This increases the complication of tracking its 
fiscal impact.^^ 

CostrelTs work represents the most meticulous and 
comprehensive fiscal analysis ever conducted on a 
school choice program — probably on any education 
program, possibly on any government program in 
any area. His final analysis found that Milwaukee 
vouchers were saving $37 million per year as of 2009. 
Without the "funding flaw," that would be the end of 
the story. However, the program also was transferring 
money from local property taxpayers to the state. The 


"funding flaw" took an additional $45 million from 
Milwaukee property taxpayers, allowing property 
taxpayers outside Milwaukee to save $52 million total 
and generating $30 million in total savings on state 
taxes. 

Florida's Legislative Office of Economic and 
Demographic Research produced the second state- 
published fiscal analysis of a school choice program 
in 2012. The results of the analysis were published 
with only a sparse supporting narrative explaining 
the method, which limits the reader's ability to assess 
its methodological quality. However, it is still worth 
noting. The office found that Florida's tax-credit 
scholarship program was saving the state $23 million 
per year as of 2011-12.^^ 

The most recent fiscal analysis was published by 
Patrick Wolf and Michael McShane in 2013. Examining 
the federally funded Washington, D.C. voucher 
program, they found that each participating student 
would have cost taxpayers $14,939 per year to educate 
in D.C. public schools, compared to voucher expenses 
of $7,500 per student. They estimate that, from 2004 
to 2009, the program saved taxpayers a total of about 
$135 million.^® 


TABLE 3 Fiscal Effects on Taxpayers 


Location 

Author 

Year 

Results 

Positive Effect 

No Visible Effect 

Negative Effect 

D.C. 

Wolf & McShane 

2013 

X 



Florida 

LOEDR* 

2012 

X 



Milwaukee 

Costrell 

2010 

X 



Florida 

OPPAGA** 

2008 

X 



Nationwide 

Aud 

2007 

X 



D.C. 

Aud & Michos 

2006 

X 




Note: This table shows all empirical studies using all methods. 

*L0EDR stands for Legislative Office of Economic and Demographic Research (State of Florida). 
**0PPAGA stands for Office of Program Policy Analysis and Government Accountability (State of Florida). 
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T here have been eight studies using valid empirical 
methods to examine how school choice affects racial 
segregation in schools. Seven of these studies find that 
school choice moves students into less racially segregated 
classrooms. The remaining study finds that school choice 
has no net impact on racial segregation. None find that 
choice increases racial segregation. 

The issue of school choice and racial segregation involves 
a number of interlocking societal concerns. Public schools 
are intractably segregated by race because students are 
assigned to schools based on where they live, and school 
choice has the potential to break down these residential 
barriers. Even so, many people have difficulty giving the 
evidence on this question a hearing. Space does not permit 
a discussion of the issues here, but they are reviewed in 
an earlier report entitled "Freedom from Racial Barriers," 
and interested readers can consult that publication.^* 

Measuring Racial Segregation 

Unfortunately, most research on school segregation is 
compromised by inadequate definitions of segregation. 
Researchers t)q3ically use the racial makeup of a 
larger administrative unit — such as a school district, 
a mrmicipality or a system of private schools — as the 
standard against which segregation in individual schools 
is measured. This problem is present, for example, in 
commonly used segregation measures such as the Index 
of Dissimilarity, the Index of Exposure, and the Gini Index. 
All this approach really does is measure the evenness of 
the racial distribution within the chosen administrative 
unit. It ignores any segregation caused by the structure of 
the administrative unit itself. Much of the segregation in 
the public school system occurs because school districts 
and municipal boundaries themselves are segregated, so 
studies using this approach effectively mask the real level 
of segregation. 

Greene provides an instructive example that shows how 
this problem undermines the validity of such measures 
of segregation. In studies using the prevailing method, 
a school that is 98 percent white is considered perfectly 
integrated if it is in a school district that also is 98 percent 
white. The school receives this perfect score even if the 
98-percent-white school district is right next door to 


another district that is 98 percent minority. Glearly this 
should be considered segregation, but the prevailing 
method masks segregation when it occurs at the district 
level. Greene issues a concise verdict on what studies like 
this really are saying: "The schools are well integrated, 
given that they are horribly segregated. 

Another common problem in the existing research on 
school segregation is the failure to compare similar grade 
levels. Elementary schools tend to be more segregated 
than secondary schools because they draw from a smaller 
geographic area. Private schools are more likely than 
public schools to be elementary schools, so a comparison 
of all public schools and all private schools will create a 
false impression of greater segregation in private schools. 
To get an accurate picture of segregation levels, researchers 
must compare elementary schools to elementary schools 
and secondary schools to secondary schools. It also is 
important not to compare student populations comprising 
only pre-kindergarten or kindergarten students, as access 
to and voluntary participation in these grade levels is 
heavily uneven. 

This report reviews all available studies using valid 
empirical methods. The best way to measure segregation 
is by comparing schools to the racial composition of the 
larger metropolitan area in which they are situated. By 
looking at the whole metropolitan area rather than a 
particular administrative unit such as a school district, 
researchers can detect levels of segregation most studies 
miss. A second-best way employed by some studies is 
to measure the occurrence of racial homogeneity — for 
example, measuring the percentage of schools that are 
more than 90 percent white or more than 90 percent 
minority. 

The studies reviewed below, although they use valid 
empirical methods, do not answer all questions relevant 
to school choice and segregation. In particular, in 
every case except one, the available evidence is only 
descriptive. Researchers working through the School 
Ghoice Demonstration Project received access to data on 
voucher students in Milwaukee that were broken down 
to the individual level and matched to their public and 
private schools, enabling that study to examine causal 
relationships in the relevant variables. In other cases. 
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it must be remembered that many factors are at work 
in determining segregation levels in public and private 
schools, and the extent to which school choice programs 
change the racial composition of schools over time cannot 
yet be measured empirically. 

However, the descriptive evidence available in these 
cases is enough to show the impact choice has on the 
school environments of participating students. Also, these 
studies do measure something important: whether choice 
transfers students from more segregated to less segregated 
schools, or vice versa. These studies further provide a 
baseline against which popular claims can be evaluated. 
Widespread claims that private schools participating 
in choice programs are heavily segregated should be 
examined against this evidence. 

What the Studies Show 

Eight empirical studies have examined segregation levels 
in public schools and choice-participating private schools 
without falling afoul of the methodological problems 
described previously. One study, the only study able to 
use individual student data to examine causal effects, 
finds no net effect. The remaining seven studies, using 
descriptive data, find that school choice moves students 
from more segregated public schools into less segregated 
private schools. 

Greene, Jonathan Mills, and Stuart Buck conducted the 
one study using causal analysis as part of the School 
Choice Demonstration Project. They were able to track 
individual students from school to school, with racial data 
on all the students and schools. They found that schools' 
racial composition differed substantially from the racial 
composition of the greater Milwaukee metro area in both 
Milwaukee public schools and voucher-participating 
private schools, so both can be considered segregated. 
However, neither system is particularly better; statistical 
tests found no significant differences between segregation 
levels in public and voucher-participating schools. 
Moreover, they found that students switching schools in 
Milwaukee was having no net effect on segregation levels 
in Milwaukee schools; this was true for students switching 
from public to private schools using vouchers, and it was 
also true of other forms of school-switching.^* 


It is important to note that the School Choice 
Demonstration Project could look only at the current 
impact of the Milwaukee voucher program. However, 
that program was created in 1990 and could have had 
a sizeable impact on segregation in its first decade or 
more, leading to a relatively stable status quo where 
segregation has equalized and the program has no further 
ongoing effect. When the U.S. Department of Education 
began tracking private school racial composition in 1994, 
Milwaukee private schools were 75 percent white; by 
2008, they were 35 percent white.*® This seismic shift was 
the result of the voucher program. One thing the voucher 
program facilitated was the creation of new private 
schools that are predominantly minority, so it is possible 
that segregation levels were always equal between public 
and private schools, and the voucher program simply 
shifted some of the heavily minority segregated schools 
to the private sector. Still, the large shakeup in both sectors 
suggests it is at least as likely that old barriers may have 
been broken down. In the absence of historical data on the 
race of individual voucher participants, that is as much as 
can be said. 

Two of the descriptive studies of the Milwaukee voucher 
program were conducted by Howard Fuller and George 
Mitchell. In the first study, they compared Milwaukee 
public elementary schools to Gatholic elementary schools 
participating in the voucher program. They found that 
58 percent of public elementary students and 38 percent 
of Gatholic elementary students attended schools that 
were racially homogeneous (more than 90 percent white 
or 90 percent minority).'® In the second study. Fuller and 
Mitchell compared Milwaukee public schools to all private 
schools participating in the voucher program. They found 
that in public schools 54 percent of elementary students 
and 37 percent of secondary students attended racially 
homogeneous schools. Students attending private schools 
in the voucher program were less likely to be in racially 
homogeneous schools; Fuller and Mitchell's data tables 
indicate that, overall, 50 percent of elementary students and 
16 percent of secondary students in voucher-participating 
private schools were in racially homogeneous schools.^* 

In a third Milwaukee study. Fuller and Deborah 
Greiveldinger compared racial enrollments in Milwaukee 
public schools with those of private schools participating 
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in Milwaukee's voucher program. They found that in 
Milwaukee public schools 58 percent of elementary 
students and 44 percent of secondary students were 
in racially homogeneous schools. Voucher students 
attending private schools were less likely to be in racially 
homogeneous schools; the data tables indicate 50 percent 
of elementary students and 29 percent of secondary 
students were in racially homogeneous schools.'^^ 

Forster conducted a fourth Milwaukee study. He 
calculated a "segregation index" measuring the difference 
between the racial composition of each school and the 
racial composition of the school-age population in its 
metropolitan area (as defined by the federal Office of 
Management and Budget). He then used linear regression 
to compare segregation levels in public schools and 
voucher-participating private schools within the city 
of Milwaukee, applying statistical controls for school 
level (elementary or secondary) to ensure appropriate 
comparisons. Forster's regression analysis found that 
voucher-participating private schools were 13 points 
less segregated than Milwaukee public schools on the 
segregation index. This would be equal to the difference 
between a school that was 60 percent white and a school 
that was 73 percent white, if both were in a city that was 
50 percent white.^^ 

Greene examined the Cleveland, Ohio voucher program. 
Examining elementary and middle schools, he found 
that 19 percent of voucher recipients attended private 
schools that fell within 10 percentage points of the racial 
composition of the metropolitan area, compared with 5 
percent of Cleveland public school students. He also found 


that 61 percent of public school students attended racially 
homogeneous schools (over 90 percent white or 90 percent 
minority), compared with half of voucher recipients.'*^ 

Forster conducted a second study of the Cleveland 
program, applying the same segregation index as in his 
Milwaukee study. He compared segregation levels in 
public schools and voucher-participating private schools 
within the city of Cleveland, comparing both with the 
racial composition of school-age children in the greater 
metro area. His regression analysis found that voucher- 
participating private schools were 18 points less segregated 
than Cleveland public schools on the segregation index. 
This would be equal to the difference between a school 
that was 60 percent white and a school that was 78 percent 
white, if both were in a city that was 50 percent white.^® 

Greene and Marcus Winters analyzed the federal voucher 
program in Washington, D.C. They foimd that in public 
schools the percentage of students who were white 
differed from the percent white of the metro area by an 
average of 40 points, compared with 34 points for private 
schools participating in the voucher program. They also 
found that 85 percent of public school students attend 
racially homogeneous schools (more than 90 percent 
white or 90 percent minority), compared with 47 percent 
of students in participating private schools. When the 
definition of "racially homogeneous" was made stricter, 
such that schools needed to be 95 percent white or 95 
percent minority to qualify, the gap widened. While 
84 percent of public school students attended racially 
homogeneous schools by that definition, 43 percent of 
students in participating private schools did so.*'’ 


TABLE 4 Racial Segregation in Schools 


Location 

Author 

Year 

Results 

Positive Effect 

No Visible Effect 

Negative Effect 

Milwaukee 

Greene et. al. 

2010 


X 


Miiwaukee 

Forster 

2006 

X 



Cleveland 

Forster 

2006 

X 



D.C. 

Greene & Winters 

2005 

X 



Milwaukee 

Fuller & Greiveldlnger 

2002 

X 



Milwaukee 

Fuller & Mitchell 

2000 

X 



Milwaukee 

Fuller & Mitchell 

1999 

X 



Cleveland 

Greene 

1999 

X 




Note: This table shows all empirical studies using all methods. 
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T here have been seven empirical studies examining 
how school choice affects civic values and 
practices, such as toleration for fhe righfs of ofhers. 
Five of fhese sfudies find fhaf school choice has a 
posifive impacf on fhese civic concerns. The remaining 
fwo sfudies find fhaf school choice has no visible 
impacf on fhem. None find fhaf choice has a negafive 
impacf on fhese values and practices. 

Measuring Civic Values and Practices 

Research on how education impacfs civic values and 
practices has measured a wide range of variables, 
including tolerance for fhe righfs of ofhers, civic 
knowledge, civic parficipafion, volunfeerism, social 
capifal, civic skills, and pafriofism. The largesf existing 
review of fhe research comparing public and private 
schools on fhese issues. Wolf's "Civics Exam," found 
fhaf if overwhelmingly poinfs to eifher no difference 
or a posifive impacf from private schooling on 
these measures, even in studies that use methods 
to compensate for fhe "selection bias" of families 
selecting info privafe schools. Readers interested in 
a fhorough overview of fhaf research should consul! 
fhaf paper. 

This reporf looks only af empirical sfudies of school 
choice programs, as opposed fo fhe broader universe 
of sfudies fhaf compare public and privafe schooling 
generally. These sfudies fend fo be mefhodologically 
superior, as better ways of accounfing for selection 
bias are often available wifh choice programs. In four 
cases, gold-sfandard random-assignmenf mefhods 
were employed. 

This reporf looks af all empirical sfudies of civic values 
and practices using all mefhods, nof jusf fhe random- 
assignmenf sfudies. This is nof fhe practice if followed 
for sfudies of academic effecfs. There are a smaller 
number of random-assignmenf sfudies for civic values 
and practices fhan is fhe case wifh academic effecfs, 
and if's dangerous fo rely on foo small a universe 
of sfudies. Moreover, no new random-assignmenf 
sfudies of civic values and practices have been 
released for more fhan 10 years; excluding a recenf 
reanalysis of old dafa, described below, fhe mosf recenf 


random-assignmenf findings were published in 2002. 
Therefore, one should nof expecf a significanf body of 
random-assignmenf sfudies will be builf up over time, 
as is occurring for fhe sfudies on academic effecfs. 

One sfudy examining a privately funded voucher 
program in San Francisco, has been excluded because 
if is only a descriptive comparison of fhe voucher- 
using and non-voucher-using populafions. Thaf sfudy 
found no visible difference in folerance for fhe righfs 
of ofhers befween fhe fwo populafions. However, as a 
descripfive analysis, fhis cannof explain much abouf 
whefher fhe voucher had an impacf, as disfincf from 
ofher facfors.“® 

If was appropriafe fo include descripfive sfudies in 
fhe review of research on racial segregation because 
descripfive informafion abouf fhe racial makeup of 
schools provides insighf info an imporfanf quesfion: 
whaf impacf school choice has on sfudenfs' school 
environmenfs. If choice is moving sfudenfs from more 
segregafed schools fo less segregafed schools (or vice 
versa) if is highly desirable fo know fhaf. Here, fhe 
descripfive information does nof confribufe fo fhe 
relevanf policy quesfions. 

The mosf widely sfudied topic in fhis field is folerance 
for fhe righfs of ofhers. Researchers generally use 
fhe same mefhod fo measure fhis topic, wifh only 
small variations. Sfudenfs are asked fo idenfify fheir 
leasf-liked group of people. Sfudenfs fypically name 
a variefy of groups ranging from neo-Nazis and the 
KKK to those who disagree with them on passionate 
political issues (for example, pro-lifers name pro- 
choicers and pro-choicers name pro-lifers) fo disliked 
religious minorifies such as evangelical Christians. 
Sfudenfs are fhen asked a baffery of yes-or-no 
quesfions on whefher fheir leasf-liked group should 
be permitted fo have or do cerfain fhings. Examples 
include voting, organizing a march, or having a book 
in fhe library sympafhetic fo fheir poinf of view. 

What the Studies Show 

One of fhe firsf empirical sfudies of school choice's 
impacf on civic values and practices was conducted 
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by Wolf, Peterson, and Martin West. They studied 
students who applied for vouchers in a privately 
funded voucher program in Washington, D.C. in 
the late 1990s (not to be confused with the federally 
funded program created in D.C. in 2004). Applicants 
were offered vouchers based on a lottery, allowing the 
researchers to use a random-assignment method. They 
found that voucher students were more likely to say 
they would "definitely permit" their least-liked group 
to perform civic actions like give a speech in their 
community or run for president.'*^ 

Another early study, by Peterson and David Campbell, 
examined the results of a nationwide privately funded 
voucher program in the early 1990s. This study 
measured levels of both tolerance and civic knowledge 
and was able to employ a random-assignment method. 
It found no visible difference in either tolerance or civic 
knowledge between the voucher and non-voucher 
student groups. 

Campbell conducted a separate analysis of data from 
this nationwide program. He found that students 
offered a voucher scored higher than their non- voucher 
counterparts on political tolerance but the same in 
civic knowledge. His original analysis was unable to 
use a random-assignment method. However, he was 
later able to refine his method to confirm the finding 
using random assignment.®^ 

Howell and Peterson analyzed random-assignment 
data from a privately funded voucher program in 


Washington, D.C. They found no visible effect on 
tolerance for the rights of others between the voucher 
and non-voucher student groups.®® 

Two recent studies by David Fleming examine data 
from the School Choice Demonstration Project in 
Milwaukee. These are not random-assignment data, 
as was noted previously in regard to the academic 
findings of the School Choice Demonstration Project. 
This should be borne in mind when interpreting the 
findings. Nonetheless, in the field of civic values and 
practices where fewer random-assignment studies 
are available and new ones do not seem likely to be 
forthcoming, other evidence is worth considering. 

Fleming examined the impact of school choice on the 
civic involvement of families, rather than just students. 
School choice does not just impact students; it also 
changes the role of the family in the life of society 
because it puts parents in charge of education. Fleming 
found that in families using Milwaukee vouchers, as 
compared with a matched sample of public school 
families, parents were more likely to be actively 
involved in their children's schools, parent-teacher 
organizations, and other education groups.®^ He also 
found parents were more likely to see a connection 
between education and the civic institutions of 
society, to say that their children were learning how 
government works, and to be involved themselves in 
civic activities.®® 


TABLE 5 Civic Values and Practices 


Location 

Author 

Year 

Results 

Positive Effect 

No Visible Effect 

Negative Effect 

Nationwide 

Campbell 

2013 

X 



Miiwaukee 

Fleming 

2012 

X 



Milwaukee 

Fleming 

2011 

X 



D.C. 

Flowell & Peterson 

2002 


X 


Nationwide 

Campbell 

2002 

X 



Nationwide 

Peterson & Campbell 

2001 


X 


D.C. 

Wolf et. al. 

2001 

X 




Note: This table shows all empirical studies using all methods. 
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Universal Choice Could Deliver an 
Education Revolution 

If school choice is so great, why are the public school 
systems in cities and states with choice still showing 
little to no overall improvement? Milwaukee public 
schools were widely dysfunctional in 1990 when the 
voucher program was enacted, and they remain widely 
dysfunctional today. There has been no "Milwaukee 
Miracle." 

But the absence of a dramatic "miracle" is not a valid 
reason to conclude that choice isn't helping. The 
government monopoly school system is so tenaciously 
resistant to change that it's unreasonable to expect 
miraculous results from any education reform. 

Yes, Choice Improves Schools 

The overall performance of a school system is affected 
by countless factors. Some of these factors, such 
as political policymaking, can change quickly and 
dramatically. Others, such as demographic factors, are 
highly stable. 

As a result, the overall performance of a school system 
can never by itself provide a reliable guide to whether 
any one factor (such as school choice) is having a 
positive effect. If a man with asthma starts taking 
a new medication, and at the same time takes up 
smoking, his overall health and ability to breathe may 
not improve, but this has no bearing on the question of 
whether the medicine is helping. 

The only way to know whether choice is having a 
positive impact is to conduct empirical research using 
high-quality scientific methods. That's the whole 
purpose of using scientific methods — to isolate the 
impact of choice from the impacts of all the other 
factors that influence academic outcomes, so it can be 
measured accurately. 

Given the remarkably unanimous research on the 
impact of choice ever)rwhere it is allowed to affect 
public schools, it is clear it is having a positive effect. It 
is wrong to say choice must be doing no good simply 


because a lot of public schools are still failing. Claims 
that choice "doesn't work" directly contradict a clear 
consensus in the scientific evidence. 

Choice Could Work Much Better. . . 

If We Let It 

And yet, while it might be unreasonable to expect 
miracles, there is still an urgent need for larger 
improvements than choice is now delivering. Are the 
results of today's programs the best that school choice 
can do? Or is it reasonable to expect more? 

The positive impact of school choice programs 
identified in the empirical research is sometimes large, 
but it is more often modest in size. That is hardly 
surprising, given that existing choice programs are 
also modest in size. If modest programs produce 
modest benefits, not dramatic benefits, is the logical 
conclusion to deny that these programs have any 
benefits and give up on them? Or to expand them until 
they are large enough to have a dramatic impact? 

Existing school choice programs are hindered in a 
number of ways, such as: 

• limits on the number of students they may serve; 

• limits on the types of students they may serve; 

• limits on the purchasing power they are allowed 
to provide; 

• limits on families' ability to supplement that 
purchasing power; and 

• limits on how students may be admitted to 
participating schools. 

An earlier report, "The Greenfield School Revolution 
and School Choice," discusses the significance of these 
limitations in more detail.®*’ 

Only Universal School Choice Can 
Sustain Dramatic Change 

Ultimately, the only way to make school reform work 
on a large scale is to break the government monopoly 
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on schooling. The monopoly isn't just one powerful 
obstacle to reform among many; if's what makes 
all the many obstacles as powerful as fhey are. The 
monopoly ensures fhaf no meaningful accounfability 
for performance can occur, excepf in rare cases as a 
result of herculean efforfs. The monopoly empowers a 
dense clusfer of rapacious special inferesfs resisting all 
efforts to improve schools. 

The monopoly creates an environment where the 
urgent need for change can'f be made a fangible parf of 
fhe daily cultural life of fhe school. Insfifutional culfure 
in fhe existing sysfem is hosfile nof just to this or that 
reform, buf to reform as such, because fhe monopoly 
excludes the only institutional basis for making fhe 
need for change seem plausible and legitimate: the 
prospect of losing fhe insfifution's clienf base and the 
funding fhaf goes wifh it. When any institution has a 
captive client base, support for irmovation vanishes. 
Reform requires people and insfifutions fo do 
uncomfortable new things, and change will not occur 
until discomfort with the status quo becomes greater 
than the discomfort of fhe change. An institution 
with captive clients can continue to function into 
the foreseeable fufure, more or less as it always has, 
without change. Why not just continue doing things in 
the way that feels comforfable and nafural? 

Worst of all, the monopoly pushes out educational 
entrepreneurs who can reinvent schools from fhe 
ground up. Only a fhriving marketplace that allows 
entrepreneurs to get the support they need by serving 
their clients better can produce sustainable innovation. 
In any field of human endeavor, whefher educafion or 
medicine or politics or art or religion or manufacturing 
or anything else, entrepreneurs who want to strike out 
in new directions and do things radically differently 
need a client base. There need to be people who will 
benefit from fhe new direction and supporf if. And 
fhat client base must be robust on three dimensions: 
size, strength, and suffrage. There must be enough 
supporters, they must have enough ability to provide 
support, and they must have enough freedom fo 
decide for fhemselves whaf fo supporf. 

The government school monopoly crowds out this 


client base. School choice has the potential to solve 
this problem by providing enough families (size) wifh 
enough dollars (sfrengfh) and enough choice (suffrage) 
to support educational entrepreneurs. Unfortunately, 
existing school choice programs fall shorf on all fhree 
dimensions. Only universal choice can open the door 
to the full-fledged revolution in schooling America 
needs for fhe new cenfury. 
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